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' Abstract 

A long standing open problem in the computational complexity theory is to separate NE from 
BPP, which is a subclass of NPt(NP) n P/Poly. In this paper, we show that NE g NPt(NP n 
Nonexponentially-Dense-Class) , where Nonexponentially-Dense-Class is the class of languages A without 
exponential density (for each constant c > 0, < 2" for infinitely many integers n). Our result 

implies NE 2 NPT(padding(NP, (;(n))) for every time constructible super-polynomial function g{n) such 
O ■ as g{n) = ^ where Padding(NP, ^(n)) is class of aU languages Lg = {slOs(l''l'-l = l-i : s £ 5} 

for B e NP. We also show NE g NPT(Ptt(NP) n TALLY). 

1. Introduction 

> . . 

' Separating the complexity classes has been one of the central problems in complexity theory. Separating 

^\ , NEXP from P/Poly is a long standing fundamental open problem in the computational complexity theory. 

CO ' Wc do not even know how to separate NEXP from BPP, which is a subclass of NPt(NP) n P/Poly proved 

<N ; by Adleman [1]. 

' Whether sparse sets are hard for complexity classes plays an important role in the computational com- 

plexity theory (for examples, [3, 15, 17, 19]). It is well known that P/Poly is the same as the class of languages 
that are truth table reducible to tally sets (P/Poly = Pjt (TALLY)). The combination of bounded number 
of queries and density provides an approach to characterize the complexity of the nonuniform computa- 
tion models. The partial progress for separating exponential time classes from nonuniform polynomial time 
classes are shown in [8, 11, 13, 16,21]. Let Nonexponentially-Dcnsc-Class be the class of languages A with- 
^ ' out exponential density (for each constant c > 0, |j4-"| < 2" for infinitely many integers n). Improving 

5^ \ Hartmanis and Herman's separation E % P„i (Nonexponentially-Dense-Class) [3], Watanabe showed E % 

Pbtt(Noncxponcntially-Dcnse-Class). Watanabe's result was improved by two research groups independently 
with incomparable results that E % P„i-e_jt(Nonexponentially-Dcnse-Class) by Lutz and Mayordomo [16], 
and EXP % P„i-s_x(Nonexponentially-Dense-Class) and E ^ P ^(Nonexponentially-Dense-Class) by 
Fu [8]. Fu's results were improved to E ^ P„i-€_x(Nonexponentially-Dcnsc-Class) by Hitchcock [13]. A re- 
cent celebrated progress was made by Williams separating NEXP from ACC [22] . It is still an open problem 
to separate NEXP from Po(„)_tt(TALLY). 

The nondeterministic time hierarchy was separated in the early research of complexity theory by Cook [7] , 
Serferas, Fischer, Meyer [20], and Zak [23]. A separation with immunity among nondeterministic computa- 
tional complexity classes was derived by AUender, Beigel, Hertranpf and Homer [2]. The difference between 
NE and NP has not been fully solved. One of the most interesting problems between them is to separate NE 
from Pt(NP). Fu, Li and Zhong [10] showed NE % P„o(i)-t (NP). Their result was later improved by Mocas 
[18] to NEXP % P„c_t(NP) for any constant c > 0. Mocas's result is optimal with respect to relativizable 
proofs, as Buhrman and Torenvliet [5] showed an oracle relative to which NEXP = Pt(NP). Buhrman, 
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Fortnow and Santhanam [4] and Fu, Li and Zhang [9] showed NEXP = P„c_x(NP)/7i'^ for every constant 
c > (two papers appeared in two conferences with a similar time). Fu, Li and Zhang showed that NEXP 
is not reducible to tally sets by the polynomial time nondetcrministic Turing reductions with the number of 
queries bounded by a sub-polynomial function g{n) such as g{n) = n >°s log « (NE ^ NPg(„-)_x(TALLY))[9]. 

In this paper, we show that NE ^ NPt(NP n Nonexponentially-Dense-Class). Our result implies 
NE ^ NPx(padding(NP, ^(n))) for every time constructible super-polynomial function g{n) such as 
g{n) = n^iogliogn]] ^ ^^^^^ Padding(NP, ^(n)) is the class of all languages Lb = {slO^ ^I'D^I'l^i : s (E B} for 
B e NP. We also show NE g NPT(Ptt(NP) n TALLY). 

This paper is organized as follows. Some notations are given in section 2. In section 3, we 
give a brief description of our method to prove the main result. In section 4, we separate NE from 
NPt(NP n Nonexponentially-Dense-Class). In section 5, we show how to use the padding method to derive 
sub-exponential density problems in the class NP. In section 6, we separate NE from NPT(Ptt(NP)nTALLY). 
The conclusions arc given in section 7. 

2. Notations 

Let N ~ {0, 1, 2, • • •} be the set of all natural numbers. Let S = {0, 1} be the alphabet for all the languages 
in this paper. The length of a string s is denoted by \s\. Let ^ be a language. is the subset of strings 
of length at most n in A. A^^ is the subset of strings of length n in A. For a finite set X, let \X\ be the 
number of elements in X . For a Turing machine Af (.), let L{M) be the language accepted by M. We use a 
pairing function (., .) with |(a;,?/)| = 0{\x\ + \y\). 

For a function t{n) : N N, let DTIME(t(?i)) be the class of languages accepted by deterministic 
Turing machines in 0{t{n)) time, and NTIME(t(n)) be the class of languages accepted by nondeterministic 
Turing machines in 0{t{n)) time. Define the exponential time complexity classes: E = U^]^DTIME(2'^"), 
EXP = U^iDTIME(2"'), NE = U^iNTIME(2™) and NEXP = U^iNTIME(2"'). 

A language L is sparse if for some constant c > 0, < n'^ for all large n. Let SPARSE represent all 

sparse languages. Let TALLY be the class of languages with alphabet {!}. 

Assume that M(.) is an oracle Turing machine. A decision computation M^{x) returns either or 1 
when the input is x and oracle is A. 

Let <^ be a type of polynomial time reductions, and S be a class of languages. Pr(S) is the class of 
languages A that are reducible to some languages to S via <^ reductions. In particular, <^ is the polynomial 
time many-one reduction, and <Jp is the polynomial time Turing reduction. 

For a class C of languages, we use NPt(C) to represent the class of languages that can be reducible to 
the languages in C via polynomial time nondeterministic Turing reductions. 

For a nondecreasing function d{n) : N N, define Density((i(7i)) to be the class of languages A with 
|^-"| < d{n) for all sufficiently large n. 

For a function f{n) : N ^ N, it is time constructible if given n, f{n) can be computed in 0{f{n)) steps 
by a deterministic Turing machine. 

A function d{n) : N ^ N is nonexponential if for every constant c > 0, d{n) < 2" for infinitely many 
integers n. Nonexponentially-Dense-Class is the class of languages A whose density function dA{n) = 
is nonexponential. 

3. Overview of Our Method 

We give a brief description about our method in this section. Our main theorem is proved by contradiction. 
Assume that NEXP C NPt(>5'), where is a language in both NP and Nonexponentially-Dense-Class. Since 

S is not of exponential density, we can find a function nondecreasing unbounded function e(l") that is 

1 

computable in 2" ' time and satisfies \S-"\ < 2"°'^ ' for infinitely many integers n. Let h{n) — n'^^^"\ 
Thus, h{n) is super-polynomial function. 

Our main technical contribution is a counting method to be combined with the classical translational 
method in deriving the separation. Select an arbitrary language Lq in DTIME(2''(")). We define the 
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language Li = {xlO^*^'^'^"!^'"^ : x G La}. This converts Lq into a language in NEXP. Using the assumption 
NEXP C NPt(<S'), we have a polynomial time oracle Turing machine Mi to accept Li with oracle S. 

Define another language L2 = {l"Om : m < 2" and there are at least m different strings zi, - ■ ■ , Zm that 
are queried by Mi with some input of length h{n)}. Wc can also show that L2 is also in NEXP. When S 
has a subexponential number of elements with length at most h(n)'~'^^\ wc show that the largest m with 
l"Om e L2 has m < 2". 

In the next, we spend 2" time to find the largest m, which will be denoted by m„. This can be easily 
done since L2 is in NPt(NP). 

For m„ with m„ < 2", consider a nondeterministic computation that given an input (x, nin) with n = \x\, 
it guesses all the strings zi, ■ • • , Zm„ , which are queried by Mi by inputs of length h{n), of S in a path. Thus, 
any query like y G S? is identical to check if y is equal to one of elements in zi , • • • , z,n„ ■ This is an 

nondeterministic computation of exponential time. It can be converted into a problem in NPt(NP). It can 

1 

be simulated in a deterministic 2" time. Since there are infinitely many integers n with jS*-"! < 2""''^ ' , 

we have infinitely many integers ni,n2,--- to meet this case with m„. < 2"'. This brings a 2" * ' time 
deterministic Turing machine Af* that Lq"' = L(Af*)^"' for some for infinitely many integers n^. We can 
construct Lq in DTIME(2''(")) to make it impossible using the standard diagonal method. This brings a 
contradiction. 



4. Main Separation Theorem 

In this section, wc present our main separation theorem. The theorem is achieved by the translational 
method, which is combined with a counting method to count the number of all possible strings queried by 
nondeterministic polynomial time oracle Turing machine. 

Definition 1. 

• Let M be an oracle nondeterministic Turing machine. Let ai ■ ■ ■ ai-i be a 0, 1-sequence, and y be an 
input for AI. Define H {M (y) , ai ■ ■ ■ ai_i) to be the set of all strings z that are queried by M{y) at the 
i-th time at some path assuming M receives answers ai, • • • , a^-i for its first i — I queries from the 
oracle (the answer for each query is either '0' or '1' from the oracle). 

• For a nondeterministic oracle Turing machine M{.) and oracle A, and an integer k, define Q{M, A, k) 
to be the set all strings z in A such that z £ H{M{y), ai ■ ■ ■ Ui-i) for some string y of length k and 
some oi • • • ai_i G {0, 1}*. 

Lemma 2. Let T be a class of languages and be closed under <^^-reductions. Then NE Q T if and only if 
NEXP c r. 

Proof: Since NE C NEXP, it is trivial that NEXP C F implies NE C F. We only prove that NE C F 
implies NEXP C F. Assume NE C F. Let L be an arbitrary language in NEXP. Assume that L G 
NTIME(2"') for some integer constant c > 1. Let L' = {xIQI^I'-I^I-^ : x e L}. Since L G NTIME(2"') 
with the constant c, we have L' G NE. We have a <^^-reduction /(.) from L to L' with f{x) = xlO'^' 
{L <^ L'). Since L' G NE C F and F is closed under <J^-reductions, we have L G F. Since L is an arbitrary 
language in NEXP, we have NEXP CP. I 

Lemma 3. Let M<,(.) be a nondeterministic polynomial time oracle Turing machine. Let A be a language 
in NP and accepted by a polynomial time Turing machine Ma{.)- Then there is a nondeterministic mn'^^^-' 
time Turing machine N(.) such that given the input (m, Af*, Af^j, 1"), 

• if 1T1 < \Q(M^, A,n)\, it outputs a subset of m different elements of Q^M^, A,n) in at least one path, 
and every path with nonempty output gives a subset of m different elements of Q{M^, A,n); and 

• if m > |(5(Af*, A, it outputs empty set in every path. 



3 



Proof: Let Ma{-) be a polynomial time nondeterministic Turing machine that accepts A, and run in time 
j^cA fQj. constant ca > 0. Let Mh.(.) have time bound n'^* . We design a nondeterministic Turing machine 
iV(.). 

Let N{.) do the following with input (m, M,, Af^i, 1"): 

1. guess strings xi, • • • , a;,„ of length n; 

2. guess a path pi and a series of oracle answers a^^i • ■ • aij.^i for A/, (x^) for i = 1, • • ■ , to; 

3. if A'/, (a;,;) makes the ji-th query Zi on path pi assuming the first the ji — 1 oracle answers are 

' ' ' — 1 1 

4. then guess a path q,; for MA{zi) 

5. if zi, ■ • • , Zrn are all different, and each Zi is accepted by AlA^Zi) on path 

6. then output zi, • • • , 

7. else output the empty set 0. 

We note that line 3 is to check if Zi is in (a;^), a^^i • • Since M^{.) runs in time n"^*, each is 

of length at most n^*. The Turing machines MA{zi) takes \zi\'^^ < rf'^^J^ time to accept z,; for i = 1, • • • , to. 
Therefore, the total time of N{.) with input (TO,M*,Myi, 1") is mnP^^\ 

I 

Lemma 4. Assume that S is in NP and S is nonexponentially dense. Then there is a 2" * * time computable 
nondecreasing function e(l") : N N such that 
1 

1. 1 5-" I < 2"°*^ ' /or infinitely many integers n; 

2. e(l"') < 2e(l") for all n; and 

3. lim„^ooe(l") = oo. 

Proof: Let e(l°) = 1. We construct e(l") at phase n. Assume that we have constructed e(l^), • • • , e(l*~^). 
Phase t below is for computing e(l*). 

Phase t 

1) . Let k be the largest number less than t with 6(1*^^^) < 6(1*^). 

2) . If t < then let e(l*) = e(l'=), and enter Phase t + 1. 

3) . If t =^ j''^^-'^ for any integer j, then let e(l') = e(l*''), and enter Phase t + 1. 

4) . Compute s = IS*^* I . 

1 

5) . If s < 2* , then let e(l*) = e(l''') + 1. 

End of Phase t. 

The purpose of line 3 is to let t = for some integer j after this line. This makes i be 

an integer and makes the computation easy at line 5. Checking the condition of the if statement at line 3 
takes t*^*^^' time via a binary search. Computing s at step 4 in Phase t takes 2*°'^' steps since S G NP. Thus, 
function e(l") is computable in 2"°* * time. Since S is nonexponentially dense, the if condition in step 5 
can be eventually satisfied and we have that e(l") is unbounded. 

Step 5 in Phase t makes function e(.) satisfy condition 1 in the lemma. Step 2 and Step 5 in Phase t 
makes function e(.) satisfy condition 2 in the lemma. The construction shows that e(l") is nondecreasing 
since e(l*) < e(l*"''^) for all integers t. 

I 
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Lemma 5. Assume that is nondecreasing unbounded function and is computable in 2"°' * time. 

Then there is a language Lq G DTIME(2" ) such that for every deterministic Turing machine M{.) in 
time 2" ' L{M)^^^ ^ Lq" for all sufficiently large n. 

Proof: Let Mi , ,■■ ■ be the list of all deterministic Turing machines that each M^. runs in at 
most 2" * ' time for all large n. The construction has infinitely phases for n = 1, 2, ■ • •. It is easy to 
see that for each 2"°' ' time Turing machine N{.), there is a 2" ' time Turing machine Mi(.) with 
L{M,)=" = L[N)='^ for ah large n. 
Phase n: 

Let xi, ■ ■ ■ ,Xn be the first n 0, 1-strings of length n by the lexicographic order 
For i = 1, • • • , n, put Xi into L^"" if and only if L{Mi){xi) rejects. 
End of Phase n. 

According to the construction of phase n. The language Lq can be computed in deterministic time 
71 • 2" • 2" * < 2" ' ^' for all large n. By the construction of Lq, for each Turing machine Mi that runs in 
time 2"'""''", L{Mi)='^ ^ L^^" for all large n. 

I 

Theorem 6 and Theorem 7 are basically equivalent. They are the main separation results achieved in this 
paper. We will find more concrete complexity classes inside NPHNonexponentially-Dense-Class in section 5. 

Theorem 6. NEXP % NPt(NP n Noncxponentially-Dense-Class). 

Proof: Assume NEXP C NPx(NP n Nonexponcntially-Dense-Class). We will bring a contradiction from 
this assumption. Since NEXP has a complete language K under reductions, if K S NPt(>5'), then 
NEXP C NPt(>5'). Let 5 be a language in NP n Nonexponentially-Dense-Class such that 

NEXP C NPt(S'). (1) 
By Lemma 4, we have a nondecreasing unbounded function e(l") that satisfies 

e(l"') < 2e(l") (2) 

and d^i^"!) < 2" for infinitely many integers n. Furthermore, function e(l") is computable in 2" 

time. Let 

/i(n) (3) 

We apply the translational method to it. Let Lq be an arbitrary language in DTIME(2''(")), and accepted 
by a deterministic Turing machine N{.) in DTIME(2''(")) time. Define Li = {xlO'^d^^D-l^^l-i) : x e Lq}. 

Since function 6(1") is computable in 2"°'"^' time, it is easy to see that Li is in EXP C NEXP. By our 
assumption (1), there is a nondeterministic polynomial time oracle Turing machine Mi[.) for Li G NPt(S') 
(Li other words, (.) accepts L). Assume that Mi{.) runs in time n'^^ for all n > 2. Let 2 < ui < U2 < 
■ ■ ■ < Uk < • ■ • he the infinite list of integers such that 

dsM = \S\^'-' <2^y^'""'\ (4) 

Define the language L2 ~ {1"0to : m < 2" and there are at least m different strings in 
Q{Mi, S, h{n))}. Let Ui be the largest integers at least 2 such that 

hin,y' < u, (5) 

for all large integers i > io (it is easy to see the existence of such an integer iq). Thus, we have 

h{n, + ly^ > u,. (6) 

For all large integers i, we have 

e(l"-) > 8ci (7) 
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< 


ds{ui) 


(by inequality (5)) 


< 


2"/ 


(by inequality (4)) 


< 




' ^ ' ' (by inequality (6)) 


< 




(by the condition rii > 2) 


< 


2 

, 2e(l"i 

2(", 


' ' (by equation (3)) 


< 


1 4e(l"i' 

2(n, 


^ ' ' (by inequality (2)) 


< 


2"' 


(by inequality (7)) 



since e(l") is nondecreasing and unbounded. Since S is of density bounded by ds{n), the number of strings 
in S queried by Mi{.)^ with inputs of length h{n) is at most ds{h{ny'^). In other words, we have 

\QiMi,S,h{n))\<ds{h{ny'). (8) 

For the case n = rii, we have the inequalities: 

ds{h{n,f') < ds{u,) (by inequality (5)) (9) 

(10) 

(11) 
(12) 

(13) 

(14) 
(15) 

By inequalities (9) to (15), and (8), we have the inequality 

\QiMi,S, h{ni))\ < 2"* for all large i. (16) 

By Lemma 3, L2 is in NEXP. By our assumption (1), L2 G NPt(>S') via some nondeterministic polynomial 
time oracle Turing machine M2(.). Assume that M2(.) runs in time n'^^ for all 71 > 2, where C2 is a positive 
constant. 

Define the language L3 = {(x, m) : m < 2l^l and there are at least m different strings zi,---,Zm in 
Q{Mi, S, h{n)), and Afi(a::10'''-I^l^~l^l~^^) has an accept path that receives answer 1 for each query (to oracle 
S) in {zi, ■ ■ ■ , Zm}, and answer for each query (to oracle S) not in {zi, • • • , z„i} }. 

By Lemma 3, we have L3 £ NE. Thus, L3 G NPt(>5') via another nondeterministic polynomial time 
oracle Turing machine M3(.). Assume that M^^.) runs in time n'^^ for all n > 2. 

In order to find the largest number m such that 1"0to G L2, m is always at most 2" . Thus, the length of 
m is at most n + 1. Using the binary search, we can find the largest m„. with l"'Om„; G L2 for i = 1, 2, ■ • •. 
Let m„; be the largest m with l"'Om G £2 for i = 1, 2, • • •. Since S G NP, to„; can be computed in 2"' 
time for some positive constant C4 for all i = 1, 2, • ■ •. By inequalityies (16), we have m„; < 2"'. 

Claim 1. For |a;| = n,;, we have xlO''^"'-'^"'^"'^ G Li if and only if (x,m„.) G £3. 

Proof: Assume that zi, ■ • ■ ,Zm„. are different elements in Q{Mi, S,h{n)). By the definition of m„., a 
query if y G 5 made by Mf (xlO'''"'^~"'~^) to the oracle 5 is identical to checking if y G {zi, • • ■ , Zm„.}- 
This is because all the strings in S that are queried are in the list zi, • • ■ , -Zm„. ■ Thus, xlO''^"')""'^^ G ii if 
and only if (a;,TO„J G £3. I 

Assume that to„; is known. We just check if [x, m„.) G L3 with |a;| = n;. For \x\ = rii, we have a: G Lq if 
and only if xlO''^"-)-"--! G Li if and only if (a;,m„J G L3 by Claim 1. Since L3 G NPt(5) and S G NP, we 
only need 2" ^ time to decide if (2;,to„) G L3 for n = ni,n2, ■ ■ ■, where C5 is a positive constant. Therefore, 
we can decide if 2: G Lq in 2"' time for \x\ ~ rii. Therefore, there is a deterministic Turing machine 
that runs in 2"^'' time and has L(M*)="' = Lq^' for all i sufficiently large. Since Lq is an arbitrary language 
in DTIME(2''^")). Function h{n) is a super-polynomial function. This brings there is a deterministic Turing 
machine that runs in 2" time and has L(A'/*)^"' = Lq"^' for all sufficiently large i, which contradicts 
Lemma 5. 

I 

Theorem 7. NE ^ NPt(NP n Nonexponentially-Dense-Class) . 

Proof: It follows from Lemma 2 and Theorem 6. I 
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Corollary 8. NEXP % NPt(NP n SPARSE). 

Although it is hard to achieve NEXP ^ Pt(NP) or NEXP % Pt(SPARSE), we still have the following 
separation. 

Corollary 9. NEXP % Pt(NP n SPARSE). 



5. Hard Low Density Problems in NP 

It is natural to ask if there exists any hard low density problem in the class NP. In this section, we show the 
existence of low density sets in class NP. They are constructed from all natural NP-hard problems under the 
well known exponential time hypothesis that NP % DTIME(2"°'") [14]. 

Definition 10. 

• A function g(n) : N ^ N is super-polynomial if for every constant c > 0, g{n) > n'^ for all large n. 

• A function f{n) : N N is sub-polynomial if for every constant c > 0, f{n) < n'^ for all large n. 

• A function g{n) : N N is called well-super-polynomial if g{n) is super-polynomial, g{n) is time 
constructible, and there is a time constructible sub-polynomial function f{n) such that f{g{n)) > n 
for all sufficiently large n. 

• A function /(n) : iV is called well sub-polynomial if f{n) is sup-polynomial, /(n) is time 
constructible, and there is another time constructible super-polynomial function h{n) such that for 
each positive constant c, f{h{nY) < n for all sufficient large n. 

Define log^^-* n = logn = [log2 n~\. For integer fc > 1, define log'*^^^' n = log(log^*''' n). 
We provide the following lemma to give some concrete slowly growing well-sub-polynomial and well- 
super-polynomial functions. 



Lemma 11. 

1. For each constant integer k > 1 and constant integer a > 1, the function 
structible function from N N . 



is time con- 



2. For each constant integer k > 1 and constant integer a > 1, the function n^'°s' ' is time constructible 
function from N ^ N . 



3. Assume k and a are fixed integers with k > 1 and a > 1. Let f{n) ~ 
^(iog<'=)n)°-i^ t/ien fih{n)) < for all large n. 

4- Assume k and a are fixed integers with k > 1 and a > I. Let f{n) = 

„(log('=)n)° + i 



,l/(log' 



,l/(log<'='n) = 



and h{n) = 
and g{n) = 



then f{g{n)) > n for all large n. 
Proof: Statement 1: It takes 0(log n) time to compute log'*^' n. It takes another 0(log n) time to compute 



(log^*^' n)-^ since a is a constant. It takes another O(logri) time to compute 



.l/OogC-'n)" 



via binary search. 



Since logn = o( 



,l/(log*' 



,l/(log<'=>n)° 



is time constructible. 



we have that the function 

Statement 2: It takes O(logri) time to compute log^*"^ ri. It takes another 0(logri,) time to compute 
m = (log^'^-' n)° since a is a constant. Using the elementary method for multiplication, we can compute 
with 0(m(logn™)^) = 0(to^ \ogn) = o(n^'°s*'"' "^°) time. Therefore, n^^°^^^^ is time constructible. 
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Statement 3: We have 



f{h{n)) = /(n('°s<'='")"-^) 

< n for all large n. 



Statement 4: We have 



f{g{n)) ^ 

> n for all large n. 



Definition 12. 

• For a language A, let padding(A, g(ri)) is the languages L = {xlO^*-'^!''"!^!"^ : x G ^}. 

• For a class A of languages, define Padding(A, to be the class of languages padding(A, for 
all A e A. 

For example, let g{n) — ri('°s'°sn) for a fixed integer k > 1 and let f{n) — rj(iogiogii)'=-i . Wc have 
2/(9(«))) > 2" for all sufficient large n. 

Definition 13. A language A is of subexponential density if for each constant c > 0, < 2" for all 

large n. 

Lemma 14. Assume that A is a language and g(n) is a super-polynomial function. Then padding(^, 17(71)) 
is language of subexponential density. 

Proof: For each language A, there are at most 2" strings of length n in A. When s is mapped into 
slOsd^D-l^l-i), its length becomes 5(|s|). Let c be an arbitrary positive constant. As (7(77) is a super- 
polynomial function, there is a constant integer 77c > 2 such that for every n > Uc, 



gin) > 77!°/^ (17) 
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Let TOc = 71c'' • We have 77c = ttt-c" . Let 777 be an arbitrary number greater than ?7ic. Let k be the largest 
integer with g(k) < m. 

Case 1: fc < 77c. The number of strings of length at most k is at most 2 • 2*" < 2^*" < 2'^"" < 2"^ < 2™= < 
2m 5 ^ Therefore, the number of strings of length at most m in padding(^, (7(77)) is at most 2™'^ . 

Case 2: k > Uc- We have 777 > g{k) > k~ by inequality (17). Thus, k < trtS. The number of strings of 
length at most k at is no more than 2 • 2^^ < 2^'^ < 2'"" < 2™^ . Therefore, the number of strings of length at 
most 777 in padding(A, 5(77)) is at most 2™'. 

In every case, we have |padding(A, 17(77))-™! < 2™^. Since c is an arbitrary positive constant, 
padding (A, 17(77)) is a language of subexponenital density by Definition 13. I 



Lemma 15. Assume that A is a language and g{n) is a strictly increasing super-polynomial function and 
f{n) is a sub-polynomial function with f{g{n)) > n, then padding(A, (7(71)) is language of density 0{2^^"'^). 

Proof: For each language A, there are at most 2" strings of length n in A. When s is mapped into 
slO^^''*"^'''*'^^-', its length becomes 5(|s|). Since g{n) is increasing super-polynomial function, 5(77) < 9(77 + 1) 
for aU large n. We have 2" < 2f'^3{n))_ xhus, padding(A, g(n)) is language of density 0(2^^"^). I 

We have Theorem 16 that shows the existence of subexponential density sets that are still far from 
polynomial time computable under the reasonable assumption that NP ^ DTIME(2" ' '). 
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Theorem 16. Assume that g{n) is a strictly increasing well- super-polynomial function, and f{n) is a sub- 
polynomial function with f{g{n)) > n. // NP ^ DTIME(2" * then for every -complete language A, 
padding (A, g(ri)) is a language of density o/ Density(2/(")), and not in DTIME(r(n)), where T{n) is an 
arbitrary function with T{g(n)) = 2" ' ' . 

Proof: Let A be a NP-complete language. The density of padding(C, follows from Lemma 15. If 

padding ( C, g(n)) is computable in time T{n), we have that A is computable in time T{g{n)) = 2" * Thus, 
NP C DTIME(2"°"'). This contradicts the condition NP % DTIME(2"°''' ). I 

The following corollary gives concrete result by assigning concrete functions for f(n),g{n) and T{n). 



Corollary 17. Let g{n) = n 



(log"=')° 



„(lo 



, and T{n) = 2 



,l/(lo 



with fixed integers 



a > 1 and k > 1. // NP ^ DTIME(2" ), then for every NP-complete language A, padding(yl, (^(ri)) is a 
language of density o/ Density (2-'''"'), and not in DTIME(T(n)). 

Proof: For g(n) = ri''°s and /(n) = ri(i°s'''' "'""^ . By statement 4 of Lemma 11, we have /(^(ri)) > n. 



For T{n) 
T{g{n)) = T 
Theorem 16. 



,l/(loE 



for an arbitrary constant c > 0. By statement 3 of Lemma 11, wc have 
The three functions satisfy the conditions in Theorem 16. The corollary follows from 

I 



We separate both NEXP and NE from NPT(padding(NP, (7(n))) for any super-polynomial time con- 
structible function gin) from to in Theorems 18 and 19. For a given g{n) : N —> N, 
NPt (padding (NP, (/(n))) is a concrete computational complexity class. 

Theorem 18. Assume that g{n) is a super-polynomial time constructive function from N to N . Then 
NEXP % NPT(padding(NP,g(n))). 



Proof: It follows from Lemma 14 and Theorem 6. 



I 



Theorem 19. Assume that g{n) is a super-polynomial time constructihle function from N to N . Then 
NE % NPT(padding(NP,5(n))). 

Proof: It follows from Lemma 2 and Theorem 18. I 



6. Separating NEXP from NPT(Ptt(NP) n TALLY) 

In this section, we separate NEXP from NPT(Ptt(NP) n TALLY). A more generalized theorem is given by 
Theorem 24. We are more carefully to combine the counting method with the translational method to prove 
it. 



Definition 20. 

• Let Ml be a nondeterministic oracle Turing machine and M2 be a deterministic oracle Turing machine. 
Define M^'^ be a nondeterministic Turing machine such that Mi{x) takes an input x, each query y 
produced by Mi is answered by M2(y), which will access an oracle during the computation. 

• Let Ml be a nondeterministic oracle Turing machine and M2 be a deterministic oracle Turing machine. 
Let A be an oracle for M2. Define {M^'^)^ be a nondeterministic Turing machine Af*^^ with oracle A 
such that Ml (a;) takes an input x, each query y produced by Mi is answered by M^{y). 



Definition 21. 
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• For an oracle Turing machine M and an integer fc, define PQ{M, y, k) to be the union of all 
H{M{y), ai ■ ■ ■ Ui-i) (see Definition 1) with i < k and ai ■ ■ ■ a.i^i G {0, 1}-'"'. 

• Assume that Mi is a nondeterministic Turing machine and M2 is a deterministic adaptive oracle Turing 
machine M{.). Let A be an oracle set, and k is an integer. Define 

Qi{M^'\A,B,ki,k2,m)= U {AnPQ{M2,z,k2)). (18) 

^e(U,eB=".-f''3(Mi,!,,fci)) 

The purpose of Lemma 22 for the proof of Theorem 24 is similar to Lemma 3 for Theorem 6. 

Lemma 22. Assume that A G NP, B G NP and Mi{.) and M2{) are polynomial time nondeter- 
ministic Turing machines. Then there is a nondeterministic machine N{.) such that given the input 
(M*^^ , Ma, Mb, fci, A:2, 1"), if m < \Qi{AI^^^ , A, B,ki, k2,ri)\, it outputs a subset of m different elements 
0/ Qi (M*^^ , A, B, fci , fc2, n) in time mn'-"^^^ in at least one path; and otherwise, it outputs empty set in every 
path, where is an polynomial time nondeterministic Turing machine to accept A, and Mb is a polynomial 
time nondeterministic Turing machine to accept B. 

Proof: We design a nondeterministic Turing machine N{.). Let N{.) do the following with input 
(M„MA,MB,fci,fc2,l"): 

1. guess strings xi, • • • , Xm of length n, 

2. guess a path hi of MB{xi) for each Xi, 

3. guess a path pi and a query yi for each Miixi), 

4. guess a path Wi and a query Zi for each M2{yi), and 

5. guess a path qt for MA{zi) for i ~ 1, • • • , m. 

6. If MB{xi) accepts in path hi, Mi{xi) queries yi in path pi for i = 1, ■ • ■ , to, M2{yi) queries Zi in path Wi for 
i ~ 1, • • • , TO, and MA{zi) accepts in path qi for i = 1, • • • , to, then N outputs all zi, • ■ • , z^. Otherwise, 
N outputs 0. 

Note that for a path pi and a query yi for Mi[xi), a part of path is ai • • ■ aj_i, j with j < ki such that 
Mi{xi) follows path pi and its j-th query is yi assuming it receives the j — 1 answers are ai ■ ■ ■ aj-i- 

Note that for a path Wi and a query Zi for M2{yi), a part of path Wi is fei • ■ ■bj_i,j with j < k2 such 
that M2{yi) follows a path Wi and its j-th query is Zi assuming it receives the j — 1 answers are 61 ■ • • foj-i- 

Since Mi(.), M2(.), Ma{-) and Mb(.) all run in polynomial time, we have that the time for N{.) is bounded 
by mn'-"^^\ I 

Definition 23. For a set B, define p{B) to be the power set of B (the class of all subsets of B). 

Theorem 24 gives another separation for NEXP from the polynomial time hierarchy. It is incomparable 
with Theorem 6. 

Theorem 24. Assume that B is an language in (NP n co-NP) n Nonexponentially-Dense-Class. Then for 
any well sub-polynomial function g{n), NEXP ^ NPT(Pg(n)-T(NP) H p{B)). 

Proof: We use a combination of counting method and translational method to prove this theorem. Let 
AIb be a polynomial time nondeterministic Turing machine to accept B, and M-^ be a polynomial time 
nondeterministic Turing machine to accept B. Let SAT be the well known NP-complete problem. 

Assume NEXP C NPT(Pg(„)-T(NP)np(i?)). Since NEXP has a complete language under -reductions, 
we assume NEXP C NPT(i^) for some K C B and also K e Pg(„)_T(NP). Let K G Pg(„)_T(SAT) via oracle 
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Turing machine Mg{.). Let n'^' be the running time of Mq. Since B G NP n co-NP and is of nonexponential 
density, by Lemma 4, we have e(l") to be a nondecreasing function with hm„_5.oo e(l") = oo, 

e(l"')<2e(l"), (19) 

and < 2" ' ' for infinitely many integers n. Furthermore, function e(l") is computable in 2" * ' 

time. 

Since g{n) is a well sub-polynomial function, let hg[n) be a well super-polynomial function (see Defini- 
tion 10) such that for each positive constant c, 

g{hg{nY) < n for all large integers n. (20) 

Let 

h{n) = min(n'=(i"\ /ig(n), 2"). (21) 

We apply the translational method to it. Let L be an arbitrary language in DTIME(2''(")). Define 
Li = {xlO''^") -.xeL}. 

Since e(l") is computable in 2"°*^' time and hg{n) is time constructible, we have that Li is in NEXP. 
Let Li G NPt{K) via an nondeterministic oracle Turing machine Mi{.) with oracle K. Assume that Mi{.) 
runs in time n'"'^ for all n > 2. Let ui < U2 < • • • < Ufc < • ■ • be the infinite list of integers at least 2 such 
that 

dB(uO = (|S|^"-)<2"'''''""'. (22) 
Let Hi be the largest integers at least 2 such that 

h{n,y' < (23) 
for all sufficiently large integers i. Thus, wc have 

h{ni + iy^>Ui. (24) 
Define L, = {l"Om : m < 2^" there are m different elements in Qi{M^''' ,SkT,B,h{nY\g{h{nY^),h{n)) 

}• 

The number of strings z £ B queried by Mi(.) with inputs of length h{n) is at most dB{h{nY^) since the 
length of z is at most h{nY^ ■ In other words. 



i/6S='i(") 



<dB{h{nY'). (25) 



As Mq is a deterministic oracle Turing machine with the number of queries bounded by function (?(.), we 
have 

\PQ{Mq,z,g{h{nY')\ < 2ff(''(")'') for each z of length at most h{nY^. (26) 
By equations (18), (25), and (26), we have the inequality 

IQiiM^^" , SAT, B,h{nY\ g{h{nY'),h{n))\ < dB{h{nY')2a^^'^'^^''^^ for aU large n. (27) 
We will show this number is less than 2^"' if n = rii for all large i. For all large i, we have 

e(l"')>8ci (28) 
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since e(l") is nondecreasing and unbounded. Since B is of density bounded by dsin), we have the inequalities 



dB{h{n,r) 



< 


dsiui) (by inequality (23)) 


(29) 


< 


2".'^°'' (by incquahty (22)) 


(30) 


< 


2(/«(n.+i)=i)V=(i-)^ (by incquahty (24)) 


(31) 


< 


2ft(n?)=i/='i"-'' condition n, > 2) 


(32) 


< 


/ 2e(l i )^ci /ed^i 1^ 

2(". ) ' (by equation (21)) 


(33) 


< 


2(nf '^"''l^i/^fi"')' equation (19)) 


(34) 


< 


2"\ (by inequality (28)) 


(35) 



Therefore, 

dB{h{niP)23^'''^"'^^'''^ < dBiHui)"') -2"-^ (by incquahty (20) and equation (21)) (36) 
< 22"-. (by inequality (35) ) (37) 

By inequalities (27), and (37) 

IQiiMf'^" , SAT, B,h{n^y\g{h{n^y'),h{n,))\ < 2^"' for ah large i. (38) 

We can assume that m < 2^" (otherwise, l"Om ^ L2). Since Mi{.) and A/q(-) run in n'^i and n'^' time, 
respectively, we have that M^''{.) runs in ri^^^'' time. By Lemma 22, the decision if l"Om e L2 can be made 
by a nondeterministic Turing machine in m 

^(„)0(i) ^ 20(") time for aU large n. We have L2 G NEXP. 
Thus, L2 G NPT(i^) via a nondeterministic Turing machine A/2(.)- Since K £ Py^, there is a constant C2 
such that we can find the largest m„ in time 2" such that l"Om G X2- 

Define the language L3 = {(a;, m) : there are at least m different strings zi, ■ • • , in 
QiiM^'-, SAT, B,h{ny\g{h{n)''^),h{n)), and (Mf^')SAT(a,ioMkl)-kl-i)) has an accept path that receives 
answer 1 for each query (to SAT), which is generated by some y G i?, in {zi, • ■ • , z^}, and answer for each 
query (to SAT), which is generated by some y E B, not in {zi, ■ ■ ■ , z^} }■ 

By Lemma 3, we have L3 G NE. Thus, L3 G NPt(A') via another polynomial time nondeterministic 
Turing machine M^^.). Assume that M^l.) runs in time n'^^ for all n >2. 

Assume rii ~ \x\. In order to find the largest number m such that l"'Om E L2, m is always at most 2^"'. 
Thus, the length of m is at most 2n. Using the binary search, we can find the largest m with l"'Om G ^2- 
Let m„. be the largest m with l"'Om G L2- Since SAT G NP, m„. can be computed in 2"; deterministic 
time for some positive constant C4. 

Assume that m„. is known. We just check if (x, m„.) G L3, where rii = \x\. It is easy to see a; G L if and 
only if 2:io''("')-"'-i g Li if and only if (x, m„J G L3. Since L3 G NPT(iir) and K G P^^, we only need 
2"i^ time to decide if (z, m„. ) G £3, where C5 is a positive constant. Therefore, we can decide if .t G i in 
2<' time. 

Therefore, there is a deterministic Turing machine Mh.(.) that runs in 2"^'' time and accepts L"' for all 
i sufficiently large. Note that L is an arbitrary language in DTIME(2''^")), and function h{n) is a super- 
polynomial function. This brings there is a deterministic Turing machine M*(.) that runs in 2" time and 
accepts L"' for all sufficiently large integers i. This contradicts Lemma 5. I 

It is easy to see that {1}* is a sparse language in P C NP n co-NP, and TALLY is the power set of {1}*. 
We have the following corollary. 

Corollary 25. NEXP ^ NPT(Pg(„)-T(NP) n TALLY) for any well sub-polynomial function g{n). 

It is well known that Pti(NP) — Po(iogri)-T(NP) (sec [6]), we have corollary 26. 
Corollary 26. NEXP ^ NPT(Ptt(NP) n TALLY). 
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7. Conclusions 



Wc show that NEXP ^ NPt(NP n Noncxponcntially-Dcnsc-Class). This rcsuh has almost reached the hmit 
of relativizable technology. A fundamental open problem is to separate NEXP from BPP. We would like 
to see the further step toward this target. Our method is a relativizable. Since there exists an oracle to 
collapse NEXP to BPP by Heller [12], separating NEXP from BPP requires a new way to go through the 
barrier of relativization. We feel that it is easy to extend results to super polynomial time classes such as 
NE % NTIME(n°('°s"))T(NTIME(nO(i°s"))n SPARSE). We will present this kind of resuUs in the extended 
version of this paper. 
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